Papers with translation studies
Opportunities for Human-centered Evaluation of Machine Translation Systems (2022.findings-naacl)
Copied to clipboard
| Challenge: | a new study examines the role of machine translation in larger user-facing systems . a sysadmin and a human factors researcher are developing evaluation tools . |
| Approach: | They argue that machine translation models are embedded in larger user-facing systems . they argue that evaluation at the systems level is still lacking . |
| Outcome: | The proposed model evaluations are based on human-computer interaction models . the authors argue that evaluations should be based more on the entire system . |
ParCorFull: a Parallel Corpus Annotated with Full Coreference (L18-1)
Copied to clipboard
| Challenge: | Recent research in multilingual coreference and automatic pronoun translation has led to important insights into the problem and some promising results. |
| Approach: | They propose a corpus annotated with full coreference chains that addresses a problem that machine translation and other multilingual natural language processing (NLP) technologies face: translation of coreference across languages. |
| Outcome: | The proposed corpus contains parallel texts for the language pair English-German, two major European languages. |
ParCorFull2.0: a Parallel Corpus Annotated with Full Coreference (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing corpus ParCorFull contains parallel texts for English-German, French and Portuguese . translation of coreference across languages is challenging for MT and other NLP applications . |
| Approach: | They describe a parallel corpus annotated with full coreference chains for multiple languages . they use the existing corpus ParCorFull to study translation of coreference across languages - a challenge for machine translation and NLP . |
| Outcome: | The proposed corpus addresses translation of coreference across languages, a problem still challenging for machine translation and other multilingual natural language processing applications. |
Towards Automatic Evaluation for Image Transcreation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for evaluating image transcreation have relied on human evaluation. |
| Approach: | They propose a suite of automatic evaluation metrics inspired by machine translation metrics . they identify cultural relevance, semantic equivalence and visual similarity as critical dimensions of image transcreation . |
| Outcome: | The proposed evaluation metrics agree with human ratings across 7 countries. |
Building an English-Chinese Parallel Corpus Annotated with Sub-sentential Translation Techniques (2020.lrec-1)
Copied to clipboard
| Challenge: | a recent study shows that human translators often resort to different non-literal translation techniques besides literal translation . however, they receive less attention in developing natural language processing (NLP) applications. |
| Approach: | They propose to have a better semantic control of extracting paraphrases from bilingual parallel corpora. |
| Outcome: | The proposed method can automatically recognize different non-literal translation techniques . the results confirm the hypothesis of the proposed method . |
Human Raters Cannot Distinguish English Translations from Original English Texts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Prior work on translationese has identified common hallmarks of translationeses, but human accuracy of identifying translated text is understudied. |
| Approach: | They perform an evaluation of English original/translated texts to examine whether raters can classify texts as being original or translated English and the features that lead rater to judge text as being translated. |
| Outcome: | The results provide critical insight into work in translation studies and context for assessments of translationese classifiers. |